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We construct and discuss the field theory for tensorial nematic order parameter coupled to gapless 
four-component fermions at the quadratic band touching point in three (spatial) dimensions. Within 
a properly formulated epsilon-expansion this theory is found to have a quantum critical point, 
which describes the (presumably continuous) transition from the semimetal into a (nematic) Mott 
insulator. The latter phase breaks the rotational, but not the time-reversal symmetry, and may be 
relevant to materials such as gray tin or mercury telluride at low temperatures. The critical point 
represents a simple quantum analogue of the familiar classical isotropic-to-nematic transition in 
liquid crystals. The properties and the consequences of this quantum critical point are discussed. Its 
existence supports the scenario of the “fixed-point collision”, according to which three-dimensional 
Fermi systems with quadratic band touching and long-range Coulomb interactions are unstable 
towards the gapped nematic ground state at low temperatures. 


I. INTRODUCTION 

Electronic systems that have their Fermi surface re¬ 
duced to Fermi points have received plenty of attention 
lately. In particular, recent progress on the problem of 
interacting Dirac electrons, when the dispersion near the 
Fermi points is linear in momentum, has indicated that 
these systems suffer a quantum phase transition with 
increasing interactions into a gapped phase, described 
well by the relativistic field theory of the Gross-Neveu- 
Yukawa type [T]. A weak long-range component of the 
Coulomb interaction appears to be an irrelevant pertur¬ 
bation at the quantum critical (QC) point, and the tran¬ 
sition is essentially due to some of its short-range compo¬ 
nents becoming sufficiently large. When the dispersion 
near the Fermi point (s) is quadratic, on the other hand, 
the result is rather different. In the bilayer graphene, 
for example, it is one of many possible mass-gaps that 
opens up already at an infinitesimal interaction [5]. The 
finite density of states that accompanies such a quadratic 
band touching (QBT) in two dimensions (2D) causes 
the long-range Coulomb interaction, loosely speaking, to 
be screened, and at the same time the non-interacting 
ground state to be unstable at weak short-range interac¬ 
tion [3l|4]. 

The situation in three-dimensional (3D) systems with 
QBT is maybe more interesting. QBT arises naturally 
in many gapless semiconductors, such as gray tin, mer¬ 
cury telluride, or certain pyrochlore iridates [S] , that fea¬ 
ture band inversion due to the spin-orbit coupling. The 
density of states at the QBT point now vanishes, and 
the long-range nature of the electron-electron interac¬ 
tion must be taken into account. It has been argued 
by Abrikosov long ago [S] , that the plain vanilla density- 
density Coulomb interaction in a 3D system with the 
QBT should turn the ground state into an example of a 
scale-invariant non-Fermi liquid (NFL). Such an exotic 
zero temperature phase would manifest itself in charac¬ 
teristic nontrivial power laws in temperature or frequency 
in various response functions of the system [7] . 


We have recently pointed out [5], on the other hand, 
that a 3D system with the chemical potential at the 
QBT and the Coulomb repulsion between the electrons 
may be unstable towards an insulating ground state with 
an anisotropic gap in the spectrum at low temperatures. 
The mechanism responsible for this instability was pro¬ 
posed to be the collision between the Abrikosov’s infrared 
stable NFL fixed point with another, QC point, which 
approaches it from the strong-coupling region as the spa¬ 
tial dimensionality of the system is taken to be decreasing 
from d = 4. The collision of fixed points has been stud¬ 
ied as a mechanism behind several interesting instabili¬ 
ties in a variety of many-body systems in the past [9HI3]. 
Within the standard one-loop calculation it occurs here 
somewhat above and close to d = 3, when both the NFL 
and the QC fixed points become complex and disappear 
from the physical space of real couplings. As a result, the 
coupling constants in the theory run away towards the 
values at which spontaneous breaking of the rotational 
symmetry appears to be the most favorable instability. 
The system in its interacting ground state would effec¬ 
tively appear as if it were under, in this case dynamically 
generated, strain. Furthermore, in the materials with the 
rest of the band structure equivalent to that of gray tin or 
mercury telluride as well, the resulting insulating ground 
state, at least at the mean-field level, would be topolog¬ 
ically nontrivial El- It would therefore be a precious 
example of a topological Mott insulator [TKIITH] . 

In order to remove the Abrikosov’s NFL fixed point, 
however, the existence of which is guaranteed close to 
four spatial dimensions, from the physical real-valued 
space of couplings, it is necessary to have a QC point 
that would collide with it with the change of some pa¬ 
rameter. Indeed, in a certain large-A^ extension of the 
theory one can show that such a QC point does exist [8]. 
At the physical value of A^ = 1, however, in the purely 
fermionic formulation of the problem the putative QC 
point lies at strong values of the short-range couplings in 
the relevant dimensions 3 < d < 4. One may therefore 
question whether such a QC point is a genuine feature 
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of the theory, and if it would, for example, survive if one 
went beyond the one-loop approximation. As we will see 
such reservations would not be entirely without grounds. 
Similar issue arises in the interacting system of linearly 
dispersing Dirac fermions [laiin]. In this case, however, 
an alternative partially bosonized Gross-Neveu-Yukawa 
formulation can be devised |21j . In this reformulation of 
the theory one finds a clearly identifiable upper critical 
dimension, which can be used to control the quantum 
critical point and compute its characteristics in pertur¬ 
bative fashion. The crucial ingredient, however, behind 
this fortunate outcome is the linearity of the Dirac quasi¬ 
particle spectrum, which allows the Lorentz symmetry, 
although absent at the level of the lattice Hamiltonian, 
to emerge dynamically at the QC point. In the systems 
with the QBT, on the other hand, such an enlarged sym¬ 
metry is certainly not expected at low energies, and it is a 
priori not even clear what dynamic scaling to assume, as 
the coupled fermion-boson system on the Gaussian level 
appears to be characterized by two different dynamical 
critical exponents, z = 1 and 2, respectively. 

Furthermore, as already implicit in and as will be 
discussed here at length, one readily finds that the mini¬ 
mal Hamiltonian with the QBT point in 3D requires the 
use of the maximal set of five four-dimensional mutually 
anticommuting Dirac matrices. This is not an accident, 
and the situation is the same in 4D, except that one there 
needs the maximal set of nine sixteen-dimensional Dirac 
matrices. Having no further anticommuting matrix left 
prohibits then the opening of an isotropic mass-gap in 
the insulating state, which is usually preferred in the sys¬ 
tems with Dirac fermions [HI |H] • This leaves as the en¬ 
ergetically next-best option the dynamical generation of 
the second-rank tensorial order parameter, which breaks 
the rotational and preserves the time-reversal symmetry. 
Such a nematic order parameter, as well known from the 
studies of liquid crystals [H] , allows a cubic rotationally- 
invariant term, which is typically responsible for a dis¬ 
continuous transition. This makes the existence of the 
QC point in this system seem additionally questionable. 

Given these difficulties which appear to be inherent 
to the problem at hand, it is quite remarkable that to¬ 
gether they conspire to allow the construction of the 
Gross-Neveu-Yukawa type of field theory for the nematic 
transition in the system with QBT that has a perturba- 
tively accessible QC point. We find that it is precisely 
the presence of the cubic invariant for the nematic order 
parameter that implies the existence of the upper critical 
dimension in the theory. The dichotomy in the dynami¬ 
cal scaling of fermions and bosons at the Gaussian hxed 
point of the theory is naturally resolved at the QC point, 
with the critical behavior becoming independent of the 
specific choice of the scaling scheme, and ultimately char¬ 
acterized by a single dynamical critical exponent z. The 
nematic quantum phase transition from the semimetallic 
phase into the insulating phase with the anisotropic gap 
described by the above QC point is therefore presum¬ 
ably continuous, at least at the level of the mean-field 


theory—in contrast to the classical thermal isotropic-to- 
nematic transition in liquid crystals [24j . To the leading 
order, the QC point is characterized by the dynamical 
critical exponent z = 2, a nontrivial positive anomalous 
dimension of the order-parameter field, and a vanishing 
anomalous dimension for the fermions. The relative signs 
of the cubic-term and the Yukawa couplings at the crit¬ 
ical point are also such that the state with fully gapped 
fermions is favored in the ordered phase, as one would 
expect from energetics |8] . 

For the sake of simplicity, in the present work we ne¬ 
glect the effects of the unscreened long-range tail of the 
Coulomb interaction. While our predictions for the crit¬ 
ical exponents near the upper critical dimension may be 
subject to quantitative improvement upon its inclusion, 
possibly already at the leading order in the e expansion, 
we see no reason why the mechanisms responsible for 
the existence of the nematic QC point should be qualita¬ 
tively altered when the long-range Coulomb interaction 
is included—as long as e is small. For larger values of e, 
in contrast, according to the scenario of the “fixed-point 
collision” [5], the QBT system with the long-range in¬ 
teraction should become unstable towards an insulating 
ground state with an anisotropic gap. With the inclu¬ 
sion of the long-range interactions the expansion around 
the upper critical dimension is thus expected to, even 
qualitatively, eventually break down at some lower crit¬ 
ical dimension, which may as well lie above the physical 
three |S]. Rather than deriving quantitative predictions 
for experimental systems, our limited objective here is 
thus to further substantiate the mechanism of “fixed- 
point collision”, by establishing the very existence of the 
nematic critical point beyond the previous large-A^ ap¬ 
proximation. 

The organization of the paper is as follows. In the 
next section we discuss the construction of the minimal 
isotropic QBT Hamiltonian in the form that most closely 
resembles the Dirac Hamiltonian, in general spatial di¬ 
mension. In Sec. lHII the Gross-Neveu-Yukawa continuum 
field theory for the nematic order parameter coupled to 
fermions is presented. We present the mean-field theory 
for the nematic quantum phase transition and discuss its 
order and the nature of the associated interacting ground 
state in Sec. lYl The structure of the renormalization 
group and the concomitant quantum critical point are 
discussed in Sec. jV] In Sec.jVljwe offer an interpretation 
of our results. Concluding remarks are given in Sec. |VH| 
Some nontrivial technical points necessary for the calcu¬ 
lation are presented in five appendices. 


II. QBT HAMILTONIANS IN DIFFERENT 
DIMENSIONS 

We first discuss the construction of the minimal, ro- 
tationally invariant and particle-hole symmetric QBT 
Hamiltonian, in general spatial dimension d. We assume 
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that in the momentum representation it has the form of 

d 

H=^GijPiPj, ( 1 ) 

with Gij as the matrix coefficients, which need to be de¬ 
termined. Obviously, Gij must transform as the compo¬ 
nents of a second-rank symmetric tensor under rotations. 
For simplicity, we set the effective band mass to 2 m = 1 
and demand that with the minimal dimension 

of the Hamiltonian to be determined. thus contains 
only even powers of the momentum’s components pi, and 
the matrix coefficients must then satisfy the anticommu¬ 
tation rules 


{Gof,G;f} = {Gd,Gof} = 0, (2) 

where Gd is any of the diagonal elements Ga, Gof is any 
of the off-diagonal element Gy with z ^ j, and Gof ^ G^f. 
Then 

d 

= Glvt + E + {Gu, G,,}) . ( 3 ) 

i=l i<j 

If we normalize the diagonal elements so that all G^ = 1 , 
= p'^ provided that the following condition is satis¬ 
fied: 


4G2f + {Gd,G'd} = 2. (4) 


Demanding further that the tensor Gy- is traceless, the 
Hamiltonian H would contain only the irreducible tensor 
PiPj — 6 ijp'^/d, and would be without the scalar term 
oc The existence of such a scalar part would only 
introduce different curvatures of the upper and the lower 
branches of the energy spectrum, and we omit it for the 
time being. We therefore set 

d 

J2Gu = 0, (5) 

i=l 

with the spectrum being quadratic, isotropic, and 
particle-hole symmetric, £±{p) = ±p^. Tracelessness, 
however, implies that, for arbitrary index k, 

d 

0 = {Gfefe, E G^^} = 2 + E {Gfcfc, G,J (6) 

1=1 i(^k) 

or, in other words that for any pair of diagonal elements 

{Gd,G:j} = ^. (7) 

When combined with Eq. Q this in particular implies 
that off-diagonal elements are to be normalized as G^f = 
d/(2 (d-l)). 

To construct the desired Hamiltonian H we therefore 
need 


d? — d 


-I- (d - 1) 


( 8 ) 


mutually anticommuting Dirac matrices, for the off- 
diagonal (first) and the diagonal (second term) elements. 
Out of d — 1 Dirac matrices for the diagonal matrices, d 
matrices Gu that satisfy Eq. 0 and square to unity can 
always be constructed. 

For example: 

( 1 ) In d = 2 only two anticommuting matrices are 
needed, and therefore may be chosen as G12 = G21 = cti, 
and Gii = —G22 = 0-3. The Hamiltonian describes the 
band touching point in bilayer graphene, for example. 
Note that H is time-reversal symmetric, and the time- 
reversal operator is T = K, the complex conjugation 
alone. Since = 1 this Hamiltonian can arise as a 
low-energy limit of a lattice Hamiltonian with spinless 
fermions hopping between sites [ 25 ]. Examples of such 
lattice Hamiltonians already exist in the literature 13 SI- 

(2) In d = 3 one needs five Dirac matrices for the 

construction, so their minimal dimension is four. We 

can choose G12 = (^3/2)72, G13 = (7^3/2)73, G23 = 
(•\/3/2)74, and then for the diagonal elements 

Gii =-^75 + ^ 71 , (9) 

G22 =- ^ 7 i) ( 10 ) 

G33 = 75. ( 11 ) 

The Hermitian Dirac matrices 7a, a = 1,...,5 satisfy 
the Clifford algebra {7a, 7b} = 2 Sab- With this particular 
choice the Hamiltonian can also be rewritten as 

5 

H ^^da{p)- 1 a, ( 12 ) 

a—1 

with da{p) = p^da{ 0 ,p) are proportional to five real 
spherical harmonics for the angular momentum of two; 
explicitly, di -I- id2 = (•\/ 3 / 2 ) sin^(d)e^®‘^, ds -I- id^ = 
(•v%/ 2 ) 810(20)6*“^, ds = ( 3 cos^d— l)/ 2 , with 9 and p 
as the spherical angles in the momentum space. 

Note that among the five four-dimensional Dirac ma¬ 
trices we can always choose two (say 74 and 75) as 
imaginary and the remaining three as real, so H is 
also time-reversal invariant, but now with (unique) T = 
7475!^ [^. Most importantly, = — 1 , and in three 
dimensions H inevitably describes particles with half¬ 
integer spin. In fact this “Luttinger Hamiltonian” is well 
known to arise from the spin-orbit coupling in gapless 
semiconductors such as gray tin, for example M mi: 
Also, the Kramers’ theorem applies in this case and dic¬ 
tates that the spectrum is doubly degenerate at any mo¬ 
mentum. 

( 3 ) For completeness, let us also display the solution 
for d = 4 . For the off-diagonal elements we now need 
six mutually anticommuting matrices, and for the di¬ 
agonal elements three more. The nine-component Clif¬ 
ford algebra has the unique irreducible representation 
being sixteen-dimensional. We may then choose the 
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off-diagonal elements as (G 12 , Gia, 023 , G 14 , G 24 , 045 ) = 
72/3(72 , 73 , 74 , 76 , 77 , 78 ), and the diagonal elements as 


Gn 

1 

= -379- 

72 

^75 + 

vf^i. 

(13) 

G22 

1 

= -379- 

72 

^75- 

vl^'- 

(14) 

G33 

1 

78 


(15) 

= -379 + 

3 


G44 

= 79- 



(16) 


Displaying H in the form equivalent to Eq. (12) would 
define the four-dimensional generalization of the £ = 2 
spherical harmonics. Note also that among the nine 
sixteen-dimensional Dirac matrices, four (say with in¬ 
dices a = 6, 7, 8,9) can be chosen to be purely imagi¬ 
nary, with the remaining hve then as real |28j . The time- 
reversal operator that commutes with H exists, and is 
unique: T = 76777879 .?^, but again = -|-1, and the 
minimal Hamiltonian in d = 4, similarly to d = 2 de¬ 
scribes a spinless particle. 

The solutions to the above conditions for the matrices 
Gij can be found in all dimensions, with the properties of 
the minimal Hamiltonian under time reversal, for exam¬ 
ple, being strongly dimension dependent, as our exam¬ 
ples already illustrate. Further details on the construc¬ 
tion of the d-dimensional QBT Hamiltonian are provided 
in Appendix The construction can also be general¬ 
ized to higher-order band touching, which would involve 
the higher-rank tensors and higher-angular-momentum 
spherical harmonics. Further elaboration of this point 
would be somewhat tangential to our main subject, and 
we leave it for another occasion. 


III. THE GROSS-NEVEU-YUKAWA FIELD 
THEORY 

We consider next the QBT fermions in d = 3 and at 
T = 0. The system may possibly harbor several QC 
fixed points which for large enough short-range interac¬ 
tions could lead to various different instabilities and cor¬ 
responding symmetry breaking patterns, in analogy to 
the 2D Dirac system describing interacting fermions on 
the honeycomb lattice [5D]. Due to the vanishing den¬ 
sity of states at the QBT point in 3D any such QC point 
will be located at strong coupling—as long as the long- 
range tail of Coulomb interaction is suppressed. With 
the long-range interaction included, however, the critical 
coupling is expected to decrease signihcantly, and might 
even vanish completely [8], in contrast to the Dirac sys¬ 
tems. We have shown recently [5], that in the isotropic 
and particle-hole symmetric case the long-range inter¬ 
action favors the nematic instability, and if indeed the 
QBT point becomes unstable at low temperatures, the 
rotational symmetry would break spontaneously. To sub¬ 
stantiate this scenario and to understand to concomitant 


ordering, in the present work we therefore focus on the 
nematic interaction channel. 

In order to establish the existence of a nematic QC 
point and to discuss its characteristics, we will suppress 
in what follows the long-range part of the Coulomb in¬ 
teraction. In the vicinity of the upper critical dimension, 
its inclusion is expected to only quantitatively improve 
our numerical predictions. Away from the upper criti¬ 
cal dimension, however, the situation may, according to 
the scenario of the “fixed-point collision” [8], dramat¬ 
ically change, and we will briefly comment on this in 
the conclusions. The continuum quantum action, cou¬ 
pled to the fluctuating nematic order parameter then is 
S = J drd^xL, with the Lagrangian density 



L — L>ip -\- L'tjjtp “h 

(17) 

with 

the individual terms defined as 



= '(/'I' (5^ +7ada(-iV))?/', 

(18) 


= gpa’p'^la'p, 

(19) 


= ~ + T') Tji + XTijTji^Ti^i 



+ 0{T^). 

(20) 


Ip is the four-component Grassmann field, whereas pa is 
a real field. The summation over the repeated indices 
is now assumed, and a = 1,...,5, and i,/, fc = 1,2,3. 
7 a are the five mutually anticommuting four-dimensional 
Dirac matrices introduced earlier. 

The real, symmetric, traceless tensor field T^- is defined 
as 


T^J = paK,ij, ( 21 ) 

where Aa are the five real, symmetric, three-dimensional 
Gell-Mann matrices. Their explicit form and important 
properties are discussed in Appendix Since the five 
spherical harmonics da(p) transform as the components 
of the traceless symmetric tensor of rank two under rota¬ 
tions, the Lagrangian L will be invariant under rotations 
provided that the five components of the tensor pai 
a = 1,..., 5 do so as well. At the level of the quantum 
mechanical averages 

{pa) = —iP^la'P), (22) 

r 

and finding {pa) ^ 0 signals spontaneous breaking of the 
rotational symmetry. The tensor can be understood 
as the nematic order parameter, in analogy with liquid 
crystals, where the identical object describes the finite 
temperature phase transition between the isotropic and 
anisotropic phases 

In the context of 2D metals, a nematic QC point de¬ 
scribing the £ = 2 Pomeranchuk instability of Fermi- 
liquid theory has been thoroughly investigated previ¬ 
ously [ini ISO] and still commands attention EH, also 
due to its potential role in the phase diagram of certain 
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high-temperature superconductors [32j . Nematic insta¬ 
bilities have also been predicted in 2D Fermi systems 
with QBT PHI]. In two dimensions, however, the order 
parameter is odd under 7r/2 spatial rotation, which for¬ 
bids a cubic term oc TrT^ in the acti on E5] . By contrast, 
the 3D system defined by Eqs. 0- ( |20| is an immediate 
generalization of the field theory describing the classical 
nematic transition in liquid crystals |24] . which is recov¬ 
ered when the fermions are decoupled, i.e., in the limit 
g —> 0. The critical point we will find shortly therefore 
represents possibly the simplest quantum analogue of this 
familiar classical nematic transition. 

The above form of the Lagrangian L contains the min¬ 
imal number of parameters, and the imaginary time, 
length, and the Grassmann and the real fields have been 
rescaled so that the coefficients in front of the first and 
the second terms in L^, and the second term in are 
brought to unity. Besides the tuning parameter r, this 
still leaves the coefficient in the first term in c, and 
the two interaction coupling constants: Yukawa coupling 
g, and the cubic term self-interaction A. These have the 
engineering dimensions 

dim[g] = dim[A] = - —^(23) 

whereas 


dynamical exponent. A similar ambiguity occurs in the 
effective order-parameter theory for the nematic insta¬ 
bility in 2D metals, when the fermions have been inte¬ 
grated out, though its resolution differs from the present 
case pSj. 

We should also comment on yet another rotational in¬ 
variant quadratic in Tij, which is proportional to 

diTijdkTkj, (26) 

and that we have omitted in L^. It couples spatial ro¬ 
tations to internal rotations of the nematic order pa¬ 
rameter, and is thus possible only when the dimension 
p of the tensor {i,j = 1,... ,p) is equal to the spa¬ 
tial dimension d (as is the case in our problem). We 
find that although of the same engineering dimension as 
the term we included at the noninteracting fixed point, 
this term develops a negative anomalous dimension to 
the leading order in interactions, and as such we expect 
it to become irrelevant at the interacting critical point 
(see Appendix . One can analogously justify the com¬ 
mon omission of this term in the studies of the classical 
isotropic-to-nematic transition in three dimensions. 

IV. MEAN-FIELD THEORY 


dim[c] = 2 — 2z. (24) 

Keeping the coefficients in fixed demands the dynam¬ 
ical critical exponent to be z = 2 at the Gaussian fixed 
point X = g = 0. One then finds that both couplings 
g and A become relevant in the infrared simultaneously 
below d = 4. This observation allows one to formulate 
a perturbative approach to the problem of the infrared 
behavior as the expansion in the small parameter 


Before we present the solution of the problem in the 
vicinity of the upper critical dimension, let us consider 
the mean-field theory in which the fluctuations of the 
order-parameter field (j)a are neglected. This approxima¬ 
tion can be justified by adding an additional “flavor” in¬ 
dex to the fermions (e.g., by allowing more than one QBT 
point at the Fermi level) and taking the limit of large fla¬ 
vor number N [5]. The mean-field theory is solved by 
minimizing the total energy 


e = 4:-d, (25) 

and search for possible non-Gaussian critical points in 
the theory. The terms C>(T^) in have for this reason 
been omitted as irrelevant to the leading order in e. The 
parameter c also is irrelevant at the Gaussian fixed point 
when z = 2. At the QC fixed point, however, we will 
find c to be shifted to a finite positive value, leading to 
nontrivial dynamical scaling of the order parameter (see 
Sec.|v]). 

The rescaling procedure involves an apparent ambigu¬ 
ity, as one might equally well fix the coefficient c in front 
of the first term in L^, oc c(Tijd^Tji)/A^ to unity, and let 
the coefficient, let us call it a, in front of the first term 
in L^, cx a{ip^drtp), to flow instead. This would dictate 
a different dynamical exponent, z = 1, at the Gaussian 
fixed point, reflecting the fact that the noninteracting 
system possesses two different characteristic time scales. 
In Appendixj^we show that this alternative prescription 
leads to an equivalent RG flow, and the same universal 
quantities at criticality. The QG point will thus be char¬ 
acterized by a single diverging time scale and a unique 


T f (I'D 

where s{p) denote the lower-branch energy eigenvalues 
of the mean-field Hamiltonian = P^da{0, ‘p)ja + 

g'paja in the presence of constant (fia, viz.. 


d, ip) = -p^ 


'i + 2d;(e,rt^ + (^ 


(28) 


A is the UV momentum cutoff, 0 < jp] < A. For con¬ 
venience, and without loss of generality, let us assume 
g > 0. The first term in Eq. (27) represents the energy 


cost of a finite (pa- By contrast, the second term decreases 
with increasing order parameter, and thus involves the 
energy gain due to a (possible) ordering. It can be inter¬ 
preted as the sum of the energies of the filled, doubly de¬ 
generate single-particle states in the ordered phase, with 
the Fermi level at the QBT. In the present model without 
the long-range Goulomb interaction and in d = 3 we ex¬ 
pect the ordered state to be energetically favorable if the 
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parameter jr exceeds a certain strong-coupling thresh¬ 
old. This threshold, however, may decrease substantially 
upon the inclusion of the long-range part of the Coulomb 
repulsion, and might even vanish completely [5]. 

In the reference frame in which the tensor order pa¬ 
rameter becomes diagonal. 




/(j)i 

V 


_ 

V3 

0 


0 0 \ 

-*-ai « 

0 


(29) 


we can write {(j)a) = {<(>sin^, 0 , 0 , 0 , ^cos^) with cj) := 
^/(j)a4’a > 0. Shifting the parameter ^ by ^ ^ ^ + 2tt/Z 
corresponds to a cyclic permutation of the a;-, y-, and 
z-axes. E.g., the state {(j)a) = (()(-\/3/2,0,0,0,1/2) for 
^ = 7 r /3 transforms into the state {(j)a) = </'(0, 0,0,0,-1) 
for ^ = TT by permuting {x,y,z) i—>■ {y,z,x). We may 
thus restrict the range of ^ to 0 < ^ < 27r/3. Finding a 
finite ^ 0 to be energetically favorable corresponds to a 
spontaneous breaking of the rotational symmetry. While 
for generic ^ no continuous part of the symmetry is left 
intact, for ^ = 0 mod 27r/3 or ^ = 7 r /3 mod 27r/3 only 
two generators of the 0(3) are broken, with a residual 
0(2) symmetry resulting. The corresponding uniaxial 
states {(j)a) = ( 0 , 0 , 0 , 0 , ± 0 ) (modulo rotations) are char¬ 
acterized by a single director, in analogy to the uniaxial 
nematic phase in liquid crystals |24) . 

The energy in the present basis reads as 



-0.04 -0.02 0 0.02 0.04 

g<p^/!s? 


FIG. 1: Mean-field energy Emf{(I> 5 ) for the uniaxial states 
{4>o.) = (0,0,0,0,05) that preserve a residual 0(2) symmetry 
(i.e., C = 0 mod 27r/3 or ^ = vr/S mod 27r/3) for different 
values of the coupling g^/r in the vicinity of the critical cou¬ 
pling (g^/r)c. The unique absolute minimum of the poten¬ 
tial is at zero or positive g05, corresponding to the isotropic 
state and uniaxial nematic fully gapped state, respectively. 
The transition into the latter phase for overcritical coupling 
is continuous. 


with the coefficient of the nonanalytic term oc 0 ®/^ as 


t{i)=2 dx j 


dQ 

(27r)= 


— x^y x'^ 2x‘^{di sin^ + cos^) + 1 


Emf(0,O = 2 '^ “ 2(g0) dx J 

X x‘^\Jx'^ -\- 2x'^{di sin^ -|- d^ cos^) -I- 1, 

(30) 

where we substituted p/y/g(j) i—>■ x and abbreviated the 
angular integration as f dfl = dd sin 0 dp. The 
integral becomes finite for —>■ oo when we add a 

suitably written zero (corresponding to the parts in Emf 
that are constant and quadratic in 0 , respectively) as 



TT 1/19 

8 2 1^30 


In 3 


^^(l-cos30 . 

(33) 


The second line of Eq. (331 approximates the numerical 
quadrature within an error range of < 0.5% for generic ^ 
and becomes exact for ^ = 0 and ^ = 7 r/ 3 . t(^) is positive 
and bounded from below and above as | < t{ 0 / ( 2^)3 ^ 


19 


The QC point at the critical coupling 


g^\ _ 5 (271)3 
r J ^ 8 47 rA ’ 


(34) 


0 = - 


47r /2 5 4 2 

^ (y“ + 

+ 2(#)V> I* i, I 


dfl 

(^ 


x^ + -] . (31) 


The mean-field energy then is (modulo irrelevant additive 
constants oc A®) 


i?MF(0 ,6 = ^0" + m (50)®/" + 0(03) (32) 


with r' = r — I the curvature at the origin and 


when the curvature r' of £'mf( 0 ) 0 </ = 0 changes sign, 

thus corresponds to a continuous phase transition—in 
contrast to the discontinuous (at least on the mean-field 
level) classical isotropic-to-nematic transition in liquid 
crystals [24j . A similar such unconventional continuous 
phase transition has recently been found in a model de¬ 
scribing the spontaneous breaking of time-reversal sym¬ 
metry in the pyrochlore iridates |34j . 

t(^) attains its unique miminum at ^ = 0. When 
5 ^/r > {g'^/r)c the transition is thus into the state with 
the order parameter (0a) = (0,0, 0,0,0), 0 > 0, which 
breaks the rotational 0(3) symmetry but leaves rota¬ 
tions about the z-axis intact. The spectrum of fermions 
in this state has a full, anisotropic ( 0 -dependent) gap. 
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with the minimal value at 9 = 7r/2 and = 50/2 
of \/^g4>/2. The system appers as if under (dynami¬ 
cally generated) uniaxial strain [TJ [3S] , and, for the sys¬ 
tems with the band structure equivalent to that of a- 
Sn or HgTe, represents a topological Mott insulator [5]. 
We depict the mean-field energy Emf{4’5) for tfi® 0(2)- 
invariant states ( 0 o) = ( 0 , 0 ,T 0 , ^ 5 ) for different values 
of the coupling /r in Fig. illustrating the continu¬ 
ous nature of the transition and the energetically favored 
minium at g<j)^ > 0 |36j . 


V. RG FLOW EQUATIONS 


In order to show the existence of the nematic QC point 
beyond the mean-field theory we include next the ef¬ 
fects of the bosonic fluctuations. To this end we per¬ 
form the standard Wilson’s renormalization group cal¬ 
culation, in which both the order parameter and the 
fermionic fields with the momenta within the momentum 
shell [A/ 6 , A] and with all Matsubara frequencies are in¬ 
tegrated out [37]. At the critical surface r = 0, to the 
leading order in the self-interaction A and the Yukawa 
coupling g the result is the differential flow of the cou¬ 
plings: 


dc 

din 6 
dg 

din 6 

dX 

din 6 


(2 - 2 z-ry0)c-f ^5^-f ^v^A^ ( 35 ) 

i(6-d-z-50-25^)5-h ^i^(c)5^ (36) 

^ 27A3 73 3 

^(6_d-.-350)A--^-— 5 . (37) 


Here, we have rescaled the couplings 
as ^ g^ and 

^ A 2 with Sd the surface 
area of the (d — l)-sphere. The parameter c has been 
rescaled as 1 —> c. The order parameter’s and 

the fermion’s anomalous dimensions, and the dynamical 
critical exponent are to the leading order 



(38) 

44 2 21 A^ 

(39) 


z = 2 + ^G(c)g^ - 50 . 

(40) 


The functions F(c), G(c), and H{c) are the result of the 
one-loop frequency integrals, and are defined as 


F{c) 

G(c) 

H{c) 


8 “h Q-^/c “h 3c 
8(l + 7c)^ ’ 

(1 + V^f’ 

4 + 37d 
4(l + 7c)'’ 


(41) 

(42) 

(43) 


Small perturbations out of the critical surface are rel¬ 
evant in the sense of the RG, and governed by the flow 
equation 


dr 

din 6 


(2 - 50)r - 




(44) 


where we have rescaled 1 —>■ r. 

Two comments on the computation of the RG flow 
equations are in order: First, we have chosen the anoma¬ 
lous dimensions 5 ^ and 5 ^ and the dynamical exponent z 
so that the coefficients in both terms in as well as the 
momentum term in [i.e., remain unity 

after the mode elimination, which forces the remaining 
coefficient c in then to flow. However, while c is irrel¬ 
evant at the Gaussian fixed point, its stable fixed-point 
value is shifted towards finite c > 0 when g ^ 0. At an 
interacting fixed point c thus scales as c oc rela¬ 

tive to a characteristic (diverging) length scale ^ (x 
The scaling form of the inverse two-point function at the 
anticipated QG point then is 

(0a(w,p)0b(O,O))”^ 5ab (45) 

with the scaling function / that has the asymptotic limits 


f{x) oc 


1 




for X <C 1 , 
for X » 1. 


(46) 


The alternative scaling prescription that chooses the 
anomalous dimensions and the dynamical exponent such 
that the coefficients of both the momentum and fre¬ 
quency terms in remain fixed, and in turn allows a 
flowing parameter a in front of the frequency term in 
a('0^9T'0), leads to the equivalent flow equations and 
same universal predictions at the interacting fixed point 
(see Appendix [d|) . 

Second, in order to arrive at Eqs. (35)-(44), we have 
kept the general counting of dimensions in the couplings, 
but have performed the angular integrations directly 
in d = 3 spatial dimensions. For details we refer to 
Appendix In Appendix we present the analogous 
derivation of the RG flow for the theory near d = 4 
with nine-component order-parameter field 4 >a and 16x 16 
gamma matrices 7 a, a = 1,..., 9. 

The mean-field result from the previous section can be 
recovered by neglecting all bosonic fluctuations (e.g., by 
reintroducing the flavor number N and taking the limit 
of large N). The flow equation for the coupling 5 ^/r then 
becomes 


djg^/r) 

In 6 


{2-d)S- 



(47) 


which in d = 3 has the zero exactly at the mean-field crit¬ 
ical coupling {g‘^/r)c = 5/8, cf. Eq. (341 and the coupling 
rescalings below Eqs. (371 and (44). 






















To show that there exists a stable (quantum critical) 
fixed point of the equations also at = 1 we introduce 
new variables 


„l/4’ 


cl/12^ 


(48) 


with c chosen such that it satisfies its own fixed-point 
equation 


0 = (2-2z)c+(^^-gc)ci/V. (49) 

In terms of the new variables we can rewrite the flow 
equations as 



-0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 -0.8 

w/Ve 


du ^ ^ ox 27 o '/i Q 

— = -(e + 2-z-3,,).--u --U, 


(50) 


^ (e -h 2 - z - ?70 - 27?^) u -h (c)^;^ (51) 


where we used Eq. (49) and also displayed the small pa¬ 
rameter e = 4 — d. 

After this change of variables, the stable fixed point 
is readily found to lie at m = ©(e^/^), v = ©(e^/^), and 
c = Since F(0) = 1, G(0) = 0, and i7(0) = 1, 

the fixed point features the critical exponents at leading 
order in e 

r^^ = 0{e^/^), r^^ = e + 0{e^/^), z = 2 + 0{e^/^), 

(52) 


and it is located at the values of u and v that satisfy the 
equations: 


21 

T 


= e, 



(53) 


The last equation, in particular, implies that at the fixed 
point sign( 7 ;) = — sign(u), whereas the first one leaves 
the sign of u undetermined. We find the following finite 
fixed-point values 


ul=T 


2 




V~e. (54) 


As the partition function is invariant under the simul¬ 
taneous sign change of g and A, so are the flow equa¬ 
tions. Thus, the two fixed points at physi¬ 

cally equivalent. It is easy to check that this fixed point 
is indeed critical, i.e., with no other unstable directions 
except for the direction of the tuning parameter r. From 
the flow of r we find the exponent v that governs the scal¬ 
ing of the correlation length ^ (x , with 5 denoting 
the deviation from the critical point, as 

l/77 = 2-P5e-PC>(e®/®). (55) 


Notably, the correction to the mean-field exponent l/v = 
2 is positive, in contrast to the QC points in Dirac 


FIG. 2: RG flow in the u-v plane for r = 0 and c = Ci(e®/®), to 
leading order in e. Arrows point towards infrared. The purely 
bosonic fixed point (B) is unstable in direction of the Yukawa 
coupling V. The fermionic fixed point (F) is critical, with no 
other unstable directions except for the direction of the tuning 
parameter r. It governs the transition into an infrared phase 
that has fully gapped fermions and a spontaneously broken 
rotational symmetry. 


fermion systems that are described by the z = 1 Gross- 
Neveu universality classes [211138]. The reason for the dif¬ 
ference in sign is the presence of the cubic term oc Tr 
in the action, which renders the bosonic contribution to 
the flow equation of the tuning parameter r [last term in 
Eq. (44)] of opposite sign as compared to systems with 
quartic bosonic interactions. Likewise, in the field the¬ 
ory of the classical isotropic-to-nematic phase transition 
in liquid crystals which allows the cubic tensor invariant 
the leading correction to Xjv is also positive |55] . 

We emphasize that our quantitative predictions for the 
critical exponents obtained near the upper critical dimen¬ 
sion, although interesting in their own right, may not de¬ 
scribe well real 3D systems in which long-range Coulomb 
interaction is important, such as a-Sn or HgTe. In these 
cases, a nematic gap might already open up at infinites¬ 
imal coupling |5]. Our result, however, at the very least 
shows that a QC fixed point exists near the upper crit¬ 
ical dimension, substantiating the “fixed-point-collision” 
scenario, and it allows to study the qualitative proper¬ 
ties of the nematic instability. We therefore refrained 
from displaying the subleading terms oc e®/® in Eqs. (52) 
and (55), which are straightforwardly computable from 
our one-loop flow equations, but do not, in our opinion, 
necessarily have direct relevance for the physics in d = 3. 

We have plotted the leadin^order RG flow in the u-v 
plane for c = C>(e®/®) in Fig. ^ showing besides the un¬ 
stable Gaussian (G) and stable fermionic (F) fixed points 
also the purely bosonic fixed point (B) at = 0 and finite 
M 7 /: 0. B is unstable in the direction of v, in analogy to 
the bosonic Wilson-Fisher fixed point in Dirac fermion 
systems [ 21 ]. 

In the calculation with four-dimensional tensor order 
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parameter we find that the bosonic fixed point B dis¬ 
appears, in full analogy to the p = 4 critical point 
in the field theory of the classical isotropic-to-nematic 
phase transition in liquid crystals [39) . In contrast, the 
fermionic fixed point (F in Fig.j^ survives for any dimen¬ 
sion p of the tensor field, with changing only its stability 
properties at larger values of p. Furthermore, our uni¬ 
versal predictions for the anomalous dimensions and 
as well as the critical exponents z and Xjv at the 
fermionic fixed point turn out to agree at leading order 
exactly with Eqs. (52) and (55), see Appendix 


VI. INTERPRETATION 

At the mean-field level, the model features a continu¬ 
ous (quantum) phase transition, described by the large- 
N fixed point of the Gross-Neveu-Yukawa field theory. It 
therefore seems natural to associate the identified fixed 
point also for N = \ with a continuous nematic quan¬ 
tum phase transition. One should note, however, that 
near the upper critical dimension and at small N the 
parameter c in becomes small at the fixed point, em¬ 
phasizing the significance of purely bosonic fluctuations. 
The result of the mean-field theory may thus as well 
be overturned in the physical limit, and the possibility 
that at small N the nature of the transition differs from 
the mean-field picture cannot be excluded with certainty. 
We believe, nonetheless, that even in a scenario with a 
discontinuous quantum phase transition the above criti¬ 
cal fixed point would still retain its physical significance: 
such a situation arises, for example, in the related classi¬ 
cal Ginzburg-Landau-Wilson theory for the (presumably 
discontinuous) thermal isotropic-to-nematic transition in 
liquid crystals, which also exhibits a critical fixed point 
in the related e = 6 — d expansion [39] . A plausible 
interpretation of the latter is that it describes the dis¬ 
appearance of the energy barrier between the high- and 
low-temperature phases, and the ultimate instability of 
the metastable symmetric phase. 

An interesting feature of the identified fixed point is 
worth pointing out. In the reference frame where the 
nematic tensor would become diagonal [Eq. @] , the 
bosonic part of the Lagrangian for uniform order param¬ 
eter {(j)a) = (())sin^, 0,0, 0, ())COS^), (j) > 0, becomes 

r 2A 

71 cos(3C)7 + (56) 

where we have displayed the unique symmetry-allowed 
quartic term as well. At intermediate steps of the RG 
the Lagrangian is analytic in cj), and the nonanalytic term 
oc will only emerge in the deep infrared, when all 
modes are integrated out. During this process it may in 
general receive contributions from the flow of all higher- 
order terms. If we focus for simplicity only on the leading 
cubic and quartic invariants and consider (without loss 
of generality) the fixed point at A < 0, we find that the 


effective quantum potential at the fixed point is mini¬ 
mized for ^ = 0. If this remains true up to the infrared, 
when the term in emerges, it indicates that the 
interacting ground state for strong coupling has (also for 
small N) the uniaxial form with cj)^ > 0 and (j)i = 0. The 
fate of fermions in this state depends crucially then on 
the sign of the remaining Yukawa coupling g. li g > 0, 
the combination g(j)^ > 0, and we recover the mean-field 
ground state with the spectrum of fermions having the 
full, anisotropic gap (cf. Sec. IV). If, on the other hand, 
g < 0 and gcj)^ < 0, the spectrum has two gapless points 
in the vicinity of which the energy dispersion becomes 
linear |S]. 

We see however, that the leading term in the flow equa¬ 
tion for A is —g^, so that a negative self-interaction A is 
generated only by a positive Yukawa coupling g. This is 
reflected in the fixed-point location, at which the signs of 
the two couplings are inevitably opposite. Incidentally, 
this feature is also responsible for the stability of the fixed 
point. Also, even if we start the RG flow at microscopic 
couplings A and g of the same sign, we always flow to a 
regime in which Xg < 0, at least in the vicinity of the 
critical surface (see Fig. [^. We thus find that the consis¬ 
tent theory in the infrared has the fermions fully gapped 
in the broken symmetry phase, in agreement with the 
mean-field result. 


VII. CONCLUSIONS 

In sum, we constructed the field theory of the fermions 
with the chemical potential at the point of quadratic 
band touching in three spatial dimensions coupled to 
the second-rank tensorial nematic order parameter. We 
argued that this field theory has an upper critical di¬ 
mension of four, and that it possesses a perturbatively 
accessible quantum critical point in the vicinity of four 
dimensions. The critical point governs the (presumably 
continuous) transition between the semimetal to the fully, 
but anisotropically gapped Mott insulator. The existence 
of the critical point in the theory supports the scenario 
of the “fixed-point collision” [5], according to which the 
Fermi system with QBT in presence of the long-range tail 
of Coulomb interaction, which we have here suppressed, 
features a lower critical dimension c?iow with 2 < < 4. 

At diow the nematic QC point and the Abrikosov’s NFL 
fixed point collide and then disappear from the real space 
of physical couplings, leaving behind the runaway flow. 
The ground-state physics of the 3D systems such as clean 
a-Sn or HgTe crucially depends on whether diow is above 
or below d = 3. The one-loop analysis points to diow 
slightly above three, which would make the QBT point 
unstable towards the nematic insulator even in the weak- 
coupling limit [5]. If, on the other hand, the true value 
of diow would turn out to be below three and both the 
Abrikosov’s NFL as well as the QC fixed points persist 
all the way down to the physical dimension, the weakly- 
interacting systems are governed by the attractive NFL 
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fixed point and should exhibit anomalous power laws in 
several observables [7]. If diow is below but not too far 
from d = 3, however, and the nematic QC point is con¬ 
sequently located at not too large a coupling, one could 
still speculate on situations, e.g., in uniformly strained 
systems or in cold-atom quantum simulators, in which 
the interactions may be tuned through the nematic QC 
point. In any case, it would obviously be desirable to 
gain a firmer theoretical control over the true value of 
diow This work is under way |41] . 
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Appendix A: Generalized real Gell-Mann matrices 

For completeness, let us review the construction of the 
generalized Gell-Mann matrices in d dimensions (the gen¬ 
erators of SU{d)) jinj- They can be classified into three 
groups. The first group is given by the real, diagonal, 
and traceless matrices 


1 /-I 0 

As = W2 = ^ 0 -10 

0 0 2j 


(A3) 


In d = 4, we find 


/I 0 0 0\ 

I 0 -1 0 0 I 
0 0 0 0 ’ 
Vo 0 0 0/ 


/O 1 0 0\ 

I 1 0 0 0 I 
0 0 0 0 ’ 
Vo 0 0 0/ 


^3 


/O 0 1 0\ 

I 0 0 0 0 I 
1 0 0 0 ’ 
Vo 0 0 0/ 


A 4 — 


/O 0 0 0\ 

I 0 0 1 0 I 
0 10 0 ’ 
Vo 0 0 0/ 




^-1 0 0 O' 
0-100 
0 0 2 0 
0 0 0 0 


\ /o 

0 

0 

1\ 

1 A 1 0 

0 

0 

0 1 

As - 0 

0 

0 

0 

1 Vl 

0 

0 

0/ 


Ay 


/O 0 0 0\ 

I 0 0 0 1 I 
0 0 0 0 ’ 
Vo 1 0 0/ 


As 


/O 0 0 0\ 

I 0 0 0 0 I 
0 0 0 1 ’ 
Vo 0 1 0/ 


/-I 0 0 0\ 

_ J_ I 0 -1 0 0 I 

- ye 0 0-10 - 

Vo 0 0 3/ 


(A4) 


In general dimension d, the {df — d)/2 + {d — 1) off- 
diagonal and diagonal, respectively, real matrices A^ 
form an orthogonal set: 


- 1^ + l)a + 1|). (Al) 

where 1 < I < d— 1 and |1),..., |d) denote the (standard) 
orthonormal basis vectors in {i\j) = 5ij. The second 
group are d{d — l)/2 real symmetric matrices that have 
nonvanishing elements only on the off-diagonal, namely 
the matrices Ujk with ones in the jk-th and kj-th entries 
and zero otherwise 


Tr(A,Ab) = 2Sat, (AS) 

and together with the unit matrix, they form a basis in 
the space of real symmetric d-dimensional matrices. We 
can therefore write the matrix element of any symmetric 
matrix M as 

A/ij = 4” (A6) 

or equivalently, as 


Ujk = \j) (A:| -I- |fc) (j|, where 1 < j < fc < d. (A2) 

The third group are d(d — l)/2 imaginary matrices which 
can be constructed similarly to Ujk- However, for the 
purposes of the present work we only need the real Gell- 
Mann matrices of the first and second group. 

In d = 2, this construction gives wi = —a^ and U 12 = 
CTi. In d = 3, we recover the standard (modulo name and 
sign conventions) 3x3 real Gell-Mann matrices: 


Ai = -wi = 



A2 = U12 = 



A 3 — Ui3 — 



A4 — U23 — 


/o 0 o\ 
0 0 1 
Vo 1 0] 


2 {dlidmj 4“ dljSmi) ^Im 

Mira. (A7) 

From here we deduce an important relation: 

2 

~ duSmj dijSjai (AS) 

which we use in the computation of the RG flow equa¬ 
tions. 




Appendix B: QBT Hamiltonian in d dimensions 

We can construct the general QBT Hamiltonian H = 
GijPiPj in d dimensions with the help of (d^ — d)/2 -|- 
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(d — 1) = (d + 2)(d — l)/2 gamma matrices 7 a. They 
have dimension d-y = with [-J denoting 

the floor function. The relationship between the and 
the gamma matrices 7 a, a = 1 ,..., (d + 2 )(d — l )/2 are 
given by the real and symmetric (generalized) d x d Gell- 
Mann matrices Aa as 


Toge ther with the Clifford algebra { 7 a, 7 h} = 26ab and 
Eq. ( |A 8 | ), this immediately gives = p'^, as expected. 
In any dimension, we can thus write the Hamiltonian in 
the form 



H = da{p)-/a, a = l,...,i(d+2)(d-l), (B2) 

with 


daip) =p‘^dai^) 


2 (d- 1 ) 


Pi^a.ijPj • 


(B3) 



FIG. 3: Diagrams that contribute to the flow equations. Solid 
lines represent fermions and dashed lines represent bosons. 
Top: contributions to (a) rji, and (b) rj^, r, p and (c) 
r. At finite external momenta k and frequencies ut the 
diagrams are evaluated using the momentum and frequency 
routings as displayed, with loop momentum \p\ £ [A/6, A] and 
frequency v G (—00,00). Bottom: contributions to (d), (e) 
dX/dlnb and (f) dg/dlnb. 


This defines the real hyperspherical harmonics da(B) for 
angular momentum of two in general dimension, with B 
denoting the spherical angles on the (d — l)-sphere in 
p-space. 


Appendix C: Computation of RG flow equations 


Let us provide some details on the computation of the 


RG flow equations (35)-(40). In the perturbative expan¬ 


sion, after integrating out the high-energy modes with 
momenta in the thin shell [A/ 6 , A], we arrive at the ef¬ 
fective action for the low-energy modes 


= 


ioj + h^*da{k)-ta)^ 


dk r°° du} 

3 (27r)'^ 27r _ 

+ {{c + 6c)uj‘^ + b^^k"^ -I- (r -I- dr)) cpa 


+ {I3 + Sj3) kikjKa,iiKbgj(j)a(t>b 

dkidk2 dwidwa r 


{9 + 5g) {(jiatl}'’ 

(Cl) 


/o (27r)2‘' d_oo (27r) 

-b (A -b dA) Aa^ijAbjiAc^ii ((/), 


where we have included the second symmetry allowed, 
quadratic, momentum-dependent term oc pkikjTuTij 
(third line in Eq. (Cll) for generality. The anomalous 
dimensions pi, and 77 ^ and the explicit renormaliza¬ 
tions Sc, Sr, S/3, Sg, and dA are determined by evaluat¬ 


ing the corresponding one-loop diagrams, as depicted in 
Fig. 771 and 77 ^ are given by the fermion-boson loop in 
Fig. j^(a), expanded to first order in external frequency 
07 and second order in external momentum k, respec¬ 
tively. rjfj) has two contributions, given by the diagrams 


in Fig.[^(b, c), when expanded to second order in external 
momentum. When alternatively expanded in frequency, 
these diagrams explicitly renormalize the frequency term 
oc cw^i/ia. The constant parts of the diagrams determine 
the shift of the tuning parameter r. At the upper crit¬ 
ical dimension the coefficients of the diagrams become 
universal (see Appendix H- Here, we will perform the 
angular integrations directly in d = 3 spatial dimensions. 
The diagrams may then receive (slight) regularization de¬ 
pendencies. To be explicit, we distribute finite external 
momentum and frequency in the fermion-boson loop in 
Fig. ^(a) such that the fermion loop momentum is on- 
shell/lp) G [A/ 6 , A], while we choose a symmetric momen¬ 
tum and frequency distribution in the fermion-fermion 
and the boson-boson loops in Fig. |^(b,c). 

One further comment on the bosonic contribution to 
77 , 7 , [Fig. |^(c)] should be made: We note that the dia¬ 
gram is invariant under the “pseudo-relativistic” rotation 
{\/cuj, k)^ :—)■ 0^v{\/cLO, k)yi with (d -b l)-dimensional ro¬ 
tation matrix 0^0 = 1, /r, jz = 0,..., d. In order to com¬ 
pute the contribution to 77 ^ one may therefore expand the 
diagram either in external frequency or in external 
momentum k^, and both prescriptions should give the 
same result due to the “pseudo-relativistic” invariance of 
the diagram. Put differently, in dc/dln 6 , the two contri¬ 
butions from 77 ^ and Sc from this diagram should cancel. 
The invariance, however, is broken by our regularization 
scheme, in which we integrate out all frequencies at once, 
rendering the coefficients of the cw^-term and the /c^-term 
different. It is therefore a priori not clear which one to 
choose as the one giving the contribution to gs. To re¬ 
solve this issue we recompute the diagram Fig.P(c) using 
a “pseudo-relativistic” regularization with loop momen¬ 
tum and frequency A /6 < ^/ciy^~+~jp < A, which gives 
the same contribution independent of whether one ex¬ 
pands in or k^. We find that the value obtained in 
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this scheme is in fact exactly the same as the one obtained 
by expanding the diagram in cuP' in our standard scheme, 
so we thus use this value as the bosonic contribution to 


•n4>- 

The boson- and fermion-loop diagrams in Fig. |^(d, e), 
respectively, renormalize the bosonic self-interaction A. 
In order to evaluate these diagrams, we continually make 


use of the identities in Eqs. (A8) and (B3| derived above. 


For instance, for the evaluation of the fermion loop in 
Fig. I^(e) we need the following angular integral over the 
{d —1)-sphere in p-space 


dil da{p)dh{p)dc{p) 
d 


d Y f 

2 {d - 1) j J ,klP-c,m 

Tr(AaAbAc)p®, 


4.S. 


2 {d-l) {d-l){d + 2){d + 4) 


(C2) 


where Sd = 27r‘^/^/F((i/2) is the surface area of the {d — 
l)-sphere and again denotes the spherical angles on 
the sphere. The evaluation of the triangle diagram in 
Fig. |(f), which renormalizes the Yukawa vertex g, is 
straightforward when making use of the orthogonality of 
the real spherical harmonics 

J dndaip)db{p) = 


In order to bring the cutoff in S'< back to A we shift the 
momenta bk ^ k and frequencies h^uj i—>■ w with suitable 
dynamical exponent 0 . The coefficients of the momentum 
terms oc in the fermionic and bosonic propagators in 
the first and second line of Eq. (Cl), respectively, can be 
fixed to one if we renormalize the fields as 


}j-{^+d+z-n^)/2^ ^ ^_(2+d+z-r,^)/2^ ^ 


However, then only one of the frequency terms can be 
fixed. We choose the fermionic term oc iw, which is done 
by setting 


z = 2 + r]i - r]^. 


(C5) 


At the noninteracting fixed point we thus have z = 2. 
The low-energy action S'< is hence brought back into the 
same form as before integrating out the momentum shell 
if the couplings are renormalized as 


dc 

din 6 
dg 

din 6 

dX 

din 6 
dr 

din 6 


(2 - 2z - g^)c + 


d5c 

51n6’ 


- (6 - d - z - 7?,^ - 277 ^) 5 -h , 

(6-d-,-3„)A+^, 


(2 - g^)r ■ 


dSr 

d\nb 


(C6) 

(C7) 

(C8) 

(C9) 


If we rescale the parameters as ^ 1 —>■ 

c, g^A‘^+^+^<i’+‘^'^'i'-^Sd/i2TrY ^ g^, 

X‘^Ad+^+3v^-eSd/{2TTy ^ A^, and rA^*-'^ ^ r, the ex¬ 
plicit evaluation of the diagrams leads to Eqs. (35|-(44) 
in the main text. 

Let us comment on the /3-term proportional to 

kikjAo^iiAd^ijcjya^b — kikjTiiTij^ (CIO) 

which couples the internal rotations of the tensor T to the 
spatial rotations. Evaluating the particle-hole diagram in 
Eig.[^(b) for zero external frequency involves the integral 


Iab{k) = 


L/b (27r)‘^ y_oo 27r 

X Tr 


iv + dJp + k)"fc iv 
Ta—;-——FTWO'fc— 


de{p)le 


+ {p+ fc)4 

8 - A 2 44,2. 

Sab 




27 

A/, 


A‘'-Mn6-hO(r), 


(Cll) 


where in the last line we have for explicitness evaluated 
the angular integral in d = 3. We note that the contribu¬ 
tion to th e bosonic propagator oc k^Sab [second term in 
Eq. (Cll)] is larger than the contribution to the /3-term 
cx (Aak) ■ (Afjfc) (third term). The anomalous dimension 
of the latter thus becomes negative and P is irrelevant 
in the sense of the RG. This justifies its omission in L^, 
as anticipated in Sec. |III| Another way to view this is to 
regard /3 as a coupling which flows according to 


^__44 2 

din6 35^ ^ 140^ 


(C12) 


which indeed has a stable fixed point at /3 = —27/176. 
We note that the action is bounded from below when 


S^S 

SYScp 


> 0 




1 4 

2 + 3 ^>«’ 


(C13) 


and a negative fixed-point value for (3 is still consistent 
with stability. 


Appendix D: Alternative dynamical scaling 

We now show that the alternative dynamical scaling 
scheme in which we fix the coefficient c in front of the 
frequency term in and in turn allow for a flowing pa¬ 
rameter a in front of the fermionic frequency term leads 
to the equivalent flow equations and the same univer¬ 
sal observables at criticality. After integrating out the 
high-energy modes the low-energy effective action can be 
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written as 
= 

dk 


fA/b 


IQ 


(2 'k)’^ J_ 
1 


duj 

2tt 


(^{a + 5a) iuj + da{k)ja'j '0 


(pa + (r + 5r)) (pa 


{j3 + 5(3) kikjAa,iiAbjj(pa(pb 


+ 


dkidk 2 dwidwa r 


(27r) 


2d 


( 2^)2 


{g + ^g) {(pa'fp^lalp) 


“t“ (A + SX) Aa^ijAbJlAc ii {(paP^bP^c) 


(Dl) 


which is equivalent to Eq. (Cl) upon identification 
1 dSa 1 ddc 


m = 


,d\nb’ 


V2 = 


c 9 In 6 ’ 


(D2) 


and c = 1/a^. Note that although w and k now have the 
same units, the engineering dimensions of g and A still 
retain their above form, Eq. (23), albeit with a different 
dynamical exponent at the Gaussian fixed point. The 
engineering dimension of the parameter a is 


dim[a] = 2 — z. 


(D3) 


After the RG step bk i—>■ k, b^u) i—>■ w and renormalizations 
of the fields as in Eq. (C4), both the momentum term 
and the frequency term of the bosonic field in S'< can 
be brought back into the form of the initial action if we 
choose 


^ = ^(2 + % 


(D4) 


and thus z = 1 in the noninteracting limit. This is in 
contrast to Eq. (C51, reflecting the ambiguity of the dy¬ 
namical scaling at the Gaussian fixed point. The beta 
functions then become 




din 6 

dX 




VSg^ 


(D5) 

J 

” 5 

(D6) 

(D7) 


with the anomalous dimensions 

_ 4 / _2\ g^ 

W - 5^(« ) ^ ^ 

_ 44^2 21 2 

77(/> — —-^ ^ ^ ’ 

35 a 4 

2 2 21 2 

= ^ag + —X , 


(D8) 

(D9) 

(DIO) 


and where we have rescaled g and A as displayed below 
Eq. (37) in the main text and i—>■ a. The func¬ 

tions E, G, and H are also precisely the ones given in 
Eqs. (41)-(43) in the main text. 


Starting the RG flow on the critical surface r = 0 in 
the vicinity of the Gaussian fixed point, A ~ 0, g ~ 0, 
we have initially z ~ 1, which renders the parameter a 
relevant in the sense of the RG. Together with a, however, 
z increases towards the infrared and the flow of a will 
eventually stop when the dynamical exponent satisfies 


-2 + r]^- -G{a ^ 


(Dll) 


Equating Eqs. (D4) and (Dll) determines the value of a 
at the interacting fixed point: 


2-2z-^—=0. (D12) 


35 a 


5 a 


Upon rescaling g‘^/a >-)■ g"^ and A^/o >-)■ A the Eq. ( |D12[) 
becomes exactly the fixed-point equation for c [Eq. 
when c = l/a^. With this identification, the flow equa¬ 
tions for g and A as well as the anomalous dimensions and 
the dynamical exponent at the fixed point have precisely 


the same form as in the main text, cf. Eqs. (36)-(40) 


withEqs. (D6)-(D11). The alternative dynamical scaling 
scheme therefore leads to the same fixed-point structure 
and universal critical exponents. The ambiguity in the 
dynamical scaling is thus resolved at the QG point, which 
is determined by the unique dynamical critical exponent 


z = 2-kC>(e®/®). 


(D13) 


Appendix E: Flow equations for four-dimensional 
tensor field 


We finally discuss the flow equations and fixed-point 
structure when evaluating the angular integral directly at 
the upper critical dimension d = 4 with the nine 16 x 16 
gamma matrices 7 a, the 16-component Dirac fermion ip, 
and the four-dimensional tensor field Tij, i,j = 1,... ,4 
with its irreducible components (pa, a = 1,..., 9. The 
computation of the one-loop diagrams in Fig.j^now gives 


dc 

din 6 
dg 

din 6 

dX 
din 6 


(2 — 2z — g,p)c H— ^g^ 4” cA^, (El) 

1 28 

-{&-d- z-g^-2g,l,)g+—H{c)g‘^, (E2) 

1 27 1 P) 

-(6-d-z-37,)A+-^--^-,3, (E3) 


with the anomalous dimensions 


7 

W = gE(c)5^ 

(E4) 

49 2 A^ 

(E5) 


z = 2 -|- -G(c)(?^ — 

(E6) 
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F(c) and G(c) are given in Eqs. (41)-(42) in the main 
text and 


H{c) 


8 + 7Vc 

8(l + v^)"‘ 


(E7) 


Out of the critical surface, the flow of the tuning param¬ 
eter is 


dr 

din 6 


(2 - r]^)r - 



1 

Vc{l + rf^^' 


(E 8 ) 


The only qualitative and universal difference to the 
computation in d = 3 is the sign of the A^-term in 
dX/dlnb, which eliminates the (unstable) purely bosonic 
fixed point (B in Fig. at 5 = 0. This is in full analogy 
to the Ginzburg-Landau-Wilson theory for the classical 
nematic phase transition in liquid crystals, which exhibits 
a fixed point if and only if the dimension p of the tensor 
order parameter is p < Pc with pc = 4 to leading order 
in the related e = 6 — d expansion [39]. However, the ex¬ 
istence of the fermionic fixed point (F in Fig. remains 
unaffected by this, and we find the nontrivial solution for 
c = 0{e^/^): 


Ai 

C*l/4 




(E9) 


where albeit Aj- and now have the same sign. Exam¬ 
ination of the stability matrix shows that the fermionic 
fixed point now exhibits a second relevant direction in di¬ 
rection of A. This again reflects the fact that for the four¬ 
dimensional tensor order parameter there is no purely 
bosonic fixed point at g = 0 and A 0 and the flow in 
the direction of A is unbounded. In agreement with the 
discussion of the classical nematic phase transition [3S] 
we thus believe that the physical situation in d = 3 is 
more accurately described by the calculation directly in 
d = 3 as presented in the main text, which gives the 
stable fermionic fixed point with g* and A* being of op¬ 
posite sign. In any case, to the leading order we find for 
the d = 4 calculation precisely the same values for the 
critical exponents at the fermionic fixed point as in the 


main text [cf. Eqs. (52) and (55)], 


(ElO) 


and 


l/i/ = 2-F5e-hC>(e®/®). (Ell) 
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